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author discusses the testing of the validity of self-pacing in a two-year 
progSeTtoi.^^ at Cdor^ State University 

Mtuofor the programed materials. The first group. 24 students who jn a room 
'equipped somewh^B^ language laboratory, were 'self-paced, wing b^s. t^w. 
»3la^>e recorder. They were encouraged to ask questms. were 
individuJrf’w’ the second group. 34 students in » 
pr<mmed materials were put on trareparenaes and 

pro?^a loudspeaker, anda screen. This 1 Tte 

araT^t with quwtions. which were answered briefly (and usu^y mEn^). The 
stud^s responded in unison when an oral •’espo^se was requred^^ 
notebooks for written responses. The teacher, standng so ihatl« coi4d s re when^ 
students were finished writir^ pared the 

Various tests were giyen to ^se two groups. a*o«9 wth » thrd gr^ of se^ 
conventional dasses.1^^ of inadequate «>^ol^the aot^^ ^ *tet 
are inrendusive. However. Tt is easy to conclude, he reports, that ^ 

achievement tests did not measure the skis that were given the most e*^sis m 
pro^am. these (proyamed) students more than held their own with students recetvmg 

the conventional type instruction; (AMM) 
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In the 8 ««ner of I 960 I was Invited to Join the staff of the Kncyclopedla 
Brliannlca Fllns, wt.ich at that tl>» was dolnp pioneerlnr work on propra»»ed 
materials. Previous to this, experimentation on proeranned mathematics was 
showinp positive results, and it was felt that the principles which were 
beine evolved for propramraed mathematics could be adapted to forelRn language 
teaching. My particular task was to see how these principles could be applied 
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to instruction in the Cerman language. Fortunately the techniques my wife 
and I had developed for the teaching of German to grade-school children were 
somewhat similar to prograamilng. although at the time we were quite unaware 
of this fact, At any rate the transition from the problems of teaching 
German to third grade children to the problems of programming the language 
for ofaer learners was not an impossible leap. Even so, the task Uu an 
arduous one. and we wrote, tested, and rewrote several times before the 
basic principles of teaching a foreign language by this means emerged. After 
two years we had accomplished the task and had completed our contract with 

Britannica. 



From the beginning there was one principle of programming that bothered 
no end: the principle of self-pacing. Some progranners took the attitude 

;hat the teacher was becoming obsolete and would be replaced by a machine in 
:he future classroom. But nobody really tested and experimented with this 
.rlnclple. It was Just taken for granted that the best way for every student 
to learn was as his own Individual pace. As a consequence all programs then 
being written were geared to this approach, including our own Ger^m program. 
No one seemed to be Inclined to ask whether some students perhaps profited 
from being in competition with their fellow learners, or pertaps needed the 

M nl 

support of snothcr huwan bclnp# 







With the temination of my contract with.E.B.F. I returned to teachin(», 
determined to test the validity of self-pacinp in a prorraraned German course. 
Althouph most of the experimental sublects who had been used in the testinp 
had done remarkably well, one could not deny the fact that they were paid 
to take the course, were peneially very superior students, and individuals 
with a good deal of inner motivation. Previous years of teachinp had warned 
me that even aroonc college students this type of individual was not the rule, 
but the e/ceptidn, and it was too much to assume that equal results would be 
obtained by an ordinary class of collece freshmen subiected to all the 
distractions and foibles that are usually found in such a jtroup. In order 
to explore some of these ideas, in the fall of 1962, at Colorado State 
University, I set up two teaching situations, usinr our proeramned materials. 

In one class I simplv issued books and tapes and asked the students to proceed 
to learn German with the help of a tape recorder. For the other class, we 
had the nro^ran put on transparencies and with the help of an overhead 
proiector, a loud speaker for the recorder, and a screen, I taueht and directed 
the pace of the progress of the students. Experience with f elf-pacing had 
already Indicated that problems In the area of lanr,uare learning should be 
resolved immediately, so T encouraged the students in this tencher-directed 
class to interrupt whenever any point of structure troubled them, or even to 
ask for a word or a phrase that might have escaped them in this kind of 
language give and take. I found that 992 of these questions could be answered 
adequately in lust a few seconds, and I openly used English as the basis of 
explanation. I stringently avoided any long discourse on the intricacies 
of grammar because this merely tended to wonfuse the students more than no 
answer nt all. T soon discovered also that the type of quentlono asked put 
me on my toes, for the questions were asked out of a knowledge of German, not 
from an ignorance of German, so that I had to answer in a few secons questioms 
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which were sham and demanded a carprehensivc view of the entire course. 

At the same tine I could not ramble off on a tanrent, as the students were 
eaper to pet the natter settled and pet back to the pronran. Once I realized 
this, I carcfullv orenared each day's work, tryinp to anticinate questions. 

Tn this T was successful and the class moved at a f.ist pace, its speed beinp 
only partly determined bv me, and nostlv by the students themselves. They 
were learninr; thev knew it, and they wanted the new structures to cone fast. 

The students in the self-oaced class were also ureed to ask questions 
whenever they needed help, but since each student was at a different place in 
the propran, questions had to be answered individually. Here we did not 
experience any * swine* to the entire class, as each individual competed only 
with himself, .and often the competition was very ooorl Before the year was 
over, the ^sycholopy Department at the University became interested in this 
prolect and decided to help me conduct a more tneaninpful experiment by pivlng 
a variety of aptitude and attitude tests. The first vear, however, was 
important in that the experimentation, inconclusive thounh it was, did at 



least reduce some of the troublesome areas, and it x^as unquestionably true 
that the tests for the teacher-directed class indicated that these students 
were learnlnp more deeply and Intensively, as Xv»ell as more enthusiastically. 

In the second year, as In the first, we did not make any attempt to 
select students accordinr to Intclllpence or any other factor. We felt we 



were justified in this because all students choosing any language course at 
a University gather as a random group, we wanted to feel that the programmed 



instruction was being subjected to the sane conditions as conventional 




classes, and the number of students selected German, or any other class, 
represent In any event onlv a small pcrc»'ntapo of the student oopulatioA, a 
factor which In Itself somewhat mitigates the validity of such an experiment. 
We franklv were not seeking conclusive results at this point; we were merely 

seeklni! trends upon which a r,ore n«anlnrful experlnent could be based later. 
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One «ouo of twentv-four studonts net In a roon eoulnned somewhat like 
a lantuare laboratory, fach stu.'ent was .unrlied with a tape recorder and a 
complete Proyran which Included books and taoes. 1-hey were rem.lred to bring 
only a notebook and nen to class. Then the students were told to proceed at 



their mm pace, seeking heln from the teacher when they felt the need. They 
were Informed, however, that thev were expected to complete the program hy 
the end of the academic vear. This, of course, somewhat modlfle.l the concept 
of self-pacing, but It was necessary to Impose this llraleatlon on then for 
their own protection, because If any student dawdled to the extent that he 
did not finish the first-year programmed German course, he would be at a 
serious disadvantage In the second year, and he could hardly have received 
full credit for the first-year course. The other class started with thirty- 



four members, meeting in an ordinary classroom, l.slng the transparencies 
with the overhead, the program was prelected, one frast at a time, onto a 
screen, and a single tape recorder sec on loud sneaker was operated by Che 
teacher. The class responded In unison when an oral response was required. 

For written responses each student kept a notebook. The teacher stood so 
that he could see when students were finished writing and paced the pres 
tlon of the next fram.accordlngly. He could also detect gross errors In 
pronvtclatlon and drill the class In the correct response without causing 
embarrassment to any Individual. Both classes were scheduled to meet five 
times a week for an hour at a tlme.g Kxamlnatlons were administered at the 
end of every thousand frames. The students In the self-paced class Informed 
the teacher when they reached these points and the tests were given Individually. 
The teacher-directed class took them as a class, just as any convenglonal class 
would do. The teacher was always present during the hour that the self-paced 
class was scheduled to meet so that students were free to ask questions If 
they needed help. The room was also open at some extra hours, so that those 



students wt>o worked more slowly could come In and contlntie with the program. 
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It was well that we allowed ourselves one full year to becor« acquainted 
with soce of the difficulties In a nroeraiaed class, both self-paced and teacher- 
directed. He fould that we had not allowed sufficient tine In the teacher 
paced class to finish the nroeran. so the second year we scheduled the two 
propranned classes for two hours a day. ten hours a week, although the sane 
credit (5 hours) was elven as was elyen for any of the university's beginning 
laneuaee classes. This extra allotment of class tine was lustlfled on the 
basis that students In the proeranned classes had no hone«.rk asslmnents. 
while students In conventional classes were expected to spend fron one to two 
hours a day In preparation for each class session. Although we wondered 

whether this two-hour scheduling t;ould deter students fron registering for 
the course, our fears were unfounded. As In the first year, we agalnhhad 
twenty-four self-pacers, that being the nunber of available tape recorders 
and nrograns. and there were thirty-five In the teacher-paced class. The two 
hours were not consecutive. The first hour for each class net In the nornlng. 
and the second hour for each was scheduled In the late afternoon. A student 
assistant was hired to oversee the self-nacera and to operate the overhead 
prolector and tape recorder for the teacher-paced group during the second 
dally session, thus relieving the teacher of an undue load. All questions 
that the students had were deferred by the student assistant and answered by 
the regular teacher on the following day. a rather unsatisfactory arrange- 



went perhaps, but the best we could devise. 

In the teacher-paced group, the entire class completed the program early 
in May and spent the last few weeks of the spring quarter reading and carrying 
on discussions In Carman. At this time also this class was reduced to one 
hour a day Instead of the originally scheduled two-hours. Of the twenty-four 




self-pacers that started In the fall, only twelve conmleted the year's work, 
with an averace score of 3.1 In the final exam, while the averape of the 
teacher-paced croup was 3.2. One must hear In mind that that averape for 
the latter croup includes weak students as well as pood, for all completed 
the course and took the final, while the self-paced averape does not Include 
the poorer students, none of whom completed the course and took the final. 

In order to have some more objective measurements of how the students were 
reactlnp to this method of Instruction and how much they were leamlnp. the 
Psycholopy Department of Colorado State University cooperated with me durlnp 
this second year by admlnlsterlnp a number of tests. We were not conten 
merely to test proprammed materials apalnst conventional materials, but we 
wished above all to determine whether proprammed Instruction would have 
any validity without the element of self-paclnp. Tests were, therefore, 
administered to three proups: the class taklnp the Cerman propram under a 

self-paced situation, the class taklnp the propram with the teacher helplnp 
to determine the pace, and several classes taklnp Gorman In a conventional 
situation, uslnp a textbook and havlnp homework asslpned to be done either 
at home or In the lanpuape department's laboratory. First of all. the 
students In every one of these classes were plven the Carroll-Sapon lanpuape 
aptitude test. In these tests the probability Is that those who score high 
have a better possibility of doing well provided the Instruction Is of hlph 
quality, this latter being one of the uncontrolled variables In the experiment. 
At various times during the year, attitude tests were administered to all 
students In the different classes. These tests were created by Dr/ Charles 
Neldt. head of the psycholopy department, and a pioneer In the field of 
attitude measurement. These tests were designed to see how the students were 
reactlnp to the method used, whether they were satisfied with the approach 



and finally whether their initial attitude was maintained as the year 
prorressod and the novelty wore off. Finally, at the end of the year, all 
these berinnlnt» Herman students were piven the ETS (Educational Testlnp 
Service) standardized German examination (written form only). This test 
is designed to measure the student’s mastery of various elements in the 
lanpuape. Althouph the students in the proprammed classes did not show the 
hiphest aptitude for lanpuaPe learninp accordinp to the Carrooll-Sapon test, 
these students consistently scored hiphest on the attitude scales, and came 
out on top in the ETS achievement test. Of the two propramcd classes, the 
teacher-directed proun had the lower aptitude score, but the hipher attitude 

and achievement scores. 

The accorapanyinp praphs illustrate the results of the tests given. The 
aptitude and achievement tests are nationally kno^^m. The attitude tests, as 
I have indicated, were developed at Colorado State University under the 
direction of Dr.lWeldt. As one can see, the number of studdnts tests was 
small, and that fact detracts from the validity of the entire venture. Yet, 
in spite of this, there are some interesting trends here, which should be 

discussed. 

First, let me say a few words regarding the evaluation of these graphs* 
The standardized German test plven has been dslpned expressly for students 
being prepared in a conventional langugpe course, and only the wtttten 
forms were used. In this, heavy emphasis is placed on the acquisition of 
vocabulary, a knowledge of rules of grammar and memorization of idiomatic 
constructions, Tn the proprammed course, on the other linnd, tlio emphasis 
is on listening comprehension and automatic responses in acceptable German 
to aural stimuli. Grammar rules as such may be 'discovered* by the student 
after he has become familiar with a structure through usage. Once the student 
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ha, for^lated his own rules, they are used as reminders, to help inhibit 
errors In the future. Vocabulary Is aecessarlly very lifted as the emphasis 
IS upon ralnlnp control of structure rather than sterile mecoriaation of 
isolated words or Idioms. Thus the really strong ponts of the program 
were not tested In the F.TS examination used, so that the students In the 
conventional classes had an advantage over those In the pro.rar.aed classea. 
one must also Keep In mind the relationship of the aptitude scores w*th 

the achievement scores. Conventional teacher two. with a class of only ei.ht 

u Antitude was 70,75 had the second hiphest achievement 

students whose averape aptitude was 

score of 50.38. which is .21 above the self-paced procramed class, whose 
averase aptitude was 66.17. more than four points below that of this small 
conventional class. Notice, too. that the aptitude of the teacher-paced 
class was only 59.36. and one of the conventional classes had an aptitude 
score of 58.26. a difference of about one point. let on the achievement 
these two comparable .roups, the teacher-dlredted pro.raMsed 

class .XE surpassed the conventional .roup by nearly fifteen points. The 
reader must be reminded that the number completing the various German courses, 
programmed and conventional. Is very small, so that validity of the scores 
can be questioned. One may well ask. however, what the score 
would have been If the teacher-paced .roup had had as hl.h an aptitude score 
as the highest scoring conventional class (70.75). Notice that the average 
achievement for all classes of 44.00. and both programmed groups scored well 
above this. Likewise, the average aptitude score Is 62.50. above the score 
of the teacher-paced class, although below that of the self-paced class. It 
is easy to conclude from these figures that even though the achlWnt 
tests did not measure the skills that were given the most emphasis In the 
program, these students more than held their own with students redelvlng the 
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conventional type instruction which the tests were designed to measure. 

It is impossible to sav how much the achievement scores were affected by the 
better attitude of the students in the programmed class. Undoubtedly, 

plays a large part in learning. And as I indicated earlier, it 
is not possible to say what part iras played by the personalities of the 
various teachers involved. 

These charts are making a comparison between different methods being 
employed by teachers to train students in the use of the German language. 
Besides this, they make a comparison between a program being used in a 
self-paced and a teacher-paced situation. Our experiment here would indicate 
that the element of self-pacing may have been over-emphasized. Perhaps the 
grouping of sttidents according to speed of learning is adequate, so that a 
program would be paced to meet the needs of each group. It is highly possibl 
that students stimulate each other in the learning situation, especially 
under the conditions of the program where all of them were involved with 
the stimulus— response procedure all of the time. The final answer, after 
all, may very well lie in a combination of the best features of conventional 
teaching with the best features of programmed insttruction. 

We do not claim for a moment that the material presented in this paper, 
or even in the graphs, is final and conslusive. Lest someone should be 
inclined to so interpret it, let me point out here some of the various and 

obvious weaknesses of the experiment. 

1. We had no adequate controls. At the time we did not feel this 
was serious, as we were more interested in trying out some ideas than in 
reaching conclusions. We do believe, however, that our experimentation may 
stimulate some reoetirch in this area which will produce conclusive results. 
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2. Only one teacher »aa involved in the progranned part of the 
experit«nt. and. to nake natters worse, that teacher was the author of the 
program and he netorally exuded all kinds of enthusiasm, which undoubtedly 
affected the attitudes and perhaps even the achievement of his students. 

3. A serious weakness arose from the fact that neither the administra- 
tion nor the language department at Colorado State University was willing to 
lend it. support and backing to this experiment. The l^aiguage teachers at 
the institution knew nothing about programing and cared less, and this 
attitude was shared by the administration to some extent. This. too. may 

have affected the students in the conventional classes. 

4 A student assistant was used to teach the afternoon hours of the 



programed course. This fact, we feel, detracted from the validity of the 
experiment, for while she was herself a competent student and had completed 
the program during the first year it was offered, she was not able to 
answer gueesions adequaftely. We should have had a regularly employed 

German teacher. 

With these weaknesses, as well as the results of the experiment, in 
mind, we would like to suggest som further areas of research. 

1. If we seriously consider the attitude of the student having an 



effect upon his ability to assimilate learning, then we must also consider 
other factors leading to the same results. We must evaluate the effect of 
gregariousness, self-confidence, shyness, and persistence upon the ability 
to learn. How do these personality traits affect attitude and achievement? 

2. In this respect also the character of the teacher may be decisive. 



An imaginative, patient teacher who approaches his subject and his students 
with enthusiasm for the subject and with a sense of humor and an understanding 
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of human nature can be a meaaurable factor In the education of the learner. 

Can a program take cognlrance of auch foctora on the part of the student and 
teacher? If It can, then this also must he a reaearchable Iten. 

3. What exactly la the role of the teacher In a ^rogramned coArae. 
or, for that natter. In a cooputer-aaslsted program? Our experiment aeema 
to Indicate that progranned Instruction puta a greater deman(.upon the teacher 
than any conventional ayatem can. Perhaps that la why some teachers have 
shied away from using programs! A good program stimulates the learner to 
think more deeply about the subject being leamed,and the learner will ask 
questions that will demand far greater knowledge on the part of the teacher. 

The teacher will have to have a comprehensive view of the entire course In ^ 

order to laeet the deraands of future student*# 

4. A completely self-paced proerara demands a preat deal from the average 

learner In the way of motivation and self-dlsclpllne. The Idea that the 
learner will find sufficient motivation Just because he usually comes up with 
the rleht answer has not been valid i/lth the average freshman of my acquaintance. 
For the well-dlsclpllned, mature* and highly motivated student* a good program 
Is something he devours happily. But this student la in a a^^a^fx small 
minority. What about the great majority? It stands to reason that something 
must be prepared that will meet the needs of the total school population. 

Thlr* we believe* can be done by creating programmed courses that will keep 
the teacher actively engaged In the Instruction. A program can and should 
be written for any subject In such a way that part* of the course can be 
used for group Instruction* with frames projected so that the entire class 
can focus on one matter at a given moment. This approach Is flexible enough 
so that the teacher can repeat frames when he finds It necessary* or expand 

and clarify when he jijiwiittll sense* that a particular class needs such help. 
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The teacher should also be able to stop the program at any point In order 
to drill his students. Even better than that, or perhaps connected with it, 
would be to have one or more drill sessions a week for this purpose. This is 
now the approach being used at a number of colleges, notably at Oakland 
Connunlty College, with great success. This sort of drill is especially 
indicated in subjects such as foreign languages and mathematics. Such drill 
constitutes overlearning and is essential if real mastery of the subject Is 
to be gained. A program can furnish information, bit it takes the teacher 

to make the subject come alive for the student. 

In conclusion, let us simply state that while it is undoubtedly true 
that some teachers think they can go on teaching the same old thing in the 
same old way, the enrollment at our summer schools and institutes testifies 
to the fact that many thousands of teachers are desperately trying to keep up 
with new technology and new methods. It Is not these teachers who are 
obsolete, but rather the tools they sometimes are forced to work with which 
are out-of-date. It is up to the creators of texts and programs to see 
that our conscientious teachers have the materials to use so that they can 
Impart knowledge and skills to their pupils la the most effective manner. 

Only the individual, whether student, teacher, writer, administrator, or 
publisher, who falls to take advantage of the opportunity to try new ideas, 
new materials, and new techniques, can be termed obsolete. Not even the 
programmer, whose program is hot off the press, can claim to have found 

the final way to Impart knowledge. 




Ernest E. Ellert 
Oakland Community College 
Union Lake, Michigan 



Appendix As Results of Teacher -paced Programed Instruction 
in German, 1963' 64. 

Mean Achievement Scores at End of First 
Year German 




(Data in preceding table plotted graphically.) 









PROJECTS 1. 2 and 19 

Mean ExpecLiition Attitude Chant^e 
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PROJECTS 1, 2 and 19 

Mean Method Attitude Change 




Teacher paced 
N = 35 



Self Paced 
N * 16 



Conventional 

N = 128 
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SCORE 

65 

80 

75 

70 

65 

60 



PROJECTS 1, 2 and 19 
Mean Total Attitude Change 




Teacher paced 
N « 35 



Self paced 
N « 16 






Conventional 
N s 107 



ADMINISTRATION 

Attitude scores for students enrolled in three instructional 
groups in Beginning German. First Quarter, 1963-64. 

(Ohe higher the score the more favorable the attitude.) 
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Final Achievement Scores 
£qj^ Five Groups of Be^innin^ German Students 



Group 


Number 


ETS German 
Examination Score 


Foreign Language 
Aptitude Test 
Score 


Teacher Paced 
Program 


11 


52.27 


59.36 


Self Paced 
Program 


6 


50.17 


66.17 


Conventional 
Teacher #1 


23 


37.52 


58.26 


Conventional 
Teacher #2 


8 


50.38 


70.75 


Miscellaneous 
Several Teachers 


28 


42.93 


64.07 


TOTAL 


76 


44.00 


62.50 



(The higher the score the better the performance 
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